Beta-function of Bruhat-Tits buildings and deformation 
of I 2 on the set of p-adic lattices 
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For the space Lat n of all the lattices in a p-adic n- dimensional linear space we 
obtain an analog of matrix beta-function; this beta-function has a degeneration to the 
Tamagawa zeta- function. We propose an analog of Berezin kernels for Lat n . We obtain 
conditions of positive definiteness of these kernels and explicit Plancherel formula. 

It is well known that affine Bruhat-Tits buildings (see, for instance, |3]) 
are right p-adic analogs of Ricmannian noncompact symmetric spaces. This 
analogy exists on the levels of geometry harmonic analysis, and special func- 
tions. We continue this parallel. 

First, we obtain an imitation of a matrix beta- function (see 0], [H]) f° r the 
spaces 

GL„(Q P )/GL„(Z P ), (0.1) 

see Theorem 2.1, this beta extends the Tamagawa zeta (Corollary 2.12, Theorem 
2.13). 

Second, we define an analog of Berezin kernels (see ^J|) for the homogeneous 
spaces (0.1). We obtain conditions of positive definiteness of these kernels (The- 
orem 2.2) and the Plancherel formula (Theorems 2.3-2.4). 

It seems, that there is no natural p-adic analogs of Hermitian Cartan do- 
mains and holomorphic discrete series. Nevertheless, the Berezin kernels on 
Riemannian symmetric spaces admit an imitation for buildings. More precisely, 
our objects are spaces of lattices, i.e., sets of vertices of buildings. These 'Berezin 
kernels' (see formula (2.5)) have sense for any building associated with a clas- 
sical p-adic group; in this paper, we consider only the series of groups GL„. In 
this case the Plancherel formula, the conditions of positive definiteness, limit 
behavior are similar to the real case as precisely as it is possible. By an anal- 
ogy with the real case, it seems that for sympletic and especially orthogonal 
groups the theory must be more rich. It is natural to wait for appearence of 
more complicated spectra (as in ^J) and of operators of restriction to some 
ideal boundary (as in ^Uj) separating these spectra; the both phenomena really 
appear for Bruhat-Tits trees, see \1'2\. 

For the Bruhat-Tits trees our kernels were known earlier (see [5], J2|), in 
this case (it is not discussed in this paper) the parallel between the Lobachevsky 
plane and the tree also can be extended to the group of diffcomorphisms of circle, 
see [T2] . 

Section 1 contains preliminaries, the results of this work are formulated in 
Section 2, proofs are contained in Sections 3-6. 

1. Preliminaries 

1.1. Notation. Denote by K the field Q p of p-adic numbers. By O we 
denote the ring of p-adic integers. By | • | we denote the norm on K. If z, z~ x £ O, 
then \z\ — 1. Also \p\ =p _1 , and \zu\ = \z\ \u\. 
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By F p we denote the field with p elements; we have F p : 
Denote by K™ the n-dimensional linear space over K. Denote by e\, . . . , e n 

the standard basis in K n . By K l , we denote the subspace in K" spanned by ei, 

■ ■ ■ , e ( . 

By GL„(K) we denote the group of invertible n x n matrices over K. By 
GL„(0) we denote the group of matrices g G GL„(K) such that all the matrix 
elements of g and g~ l are integer. The group GL n (Q) is a maximal compact 
subgroup in GL„(K). 

By Lat„ we denote the space of all lattices (see a definition in 1.2) in K™. 
By Z 2 (Lat n ) we denote the Hilbert space of complex- valued functions / on Lat„ 
satisfying the condition J^r \f(R)\ 2 < 00 i this space is equipped with the scalar 
product 

</i,/ 2 >= £ 

i?6Lat„ 

1.2. Spaces of lattices. A lattice in K" is a compact open O-submodule. 
Recall, that any lattice R can be represented in the form 

fl = 0/iffi-..ffiO/ n , (1.1) 

where fx, ... f n is some basis in K™, see [TJI, §11.2. By O n we denote the lattice 
Oei©---eOe„. 

The group GL„(K) acts transitively on Lat n . The stabilizer of the lattice 
O™ is GL„(0). Thus, 

Lat„ = GL n (K)/GL n (Q). 

Orbits of the compact group GL„(0) on Lat n are finite. Each orbit contains 
a unique representative of the form 

p kl Oei® ■ ■ ■ ®p kn Oe n , where k x ^ ... ^ k n , (1.2) 

see H3, §11.2, Theorem 2. 

In other words, the space GL„(0) \ Lat„ of GL n (0)-orbits on Lat„ is in 
one-to-one correspondence with the set whose elements are collections of 
integers 

k : ki > . . . > k n . (1.3) 

Denote by C[k] the orbit containing the lattice (1.2). 

The set *p+ = GL„(0) \ Lat„ coincides with the space of double cosets 
GL„(0)\GL„(K)/GL n (0). 

For s G Z, denote by m s the number of kj equal to s. The number of points 
in the orbit C[k] is 



p £ Mj+1 ) %ni<| ^ (1 _ ri) 

n s n!<;< roa (i-^) 



^( k ) = t^TTt m ZTK , (1-4) 



see |3, formula (V.2.9). 
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1.3. Volume. There exists a unique up to a scalar factor translation 
invariant measure {volume) on K". We normalize the volume in IK™ by the 
condition 

vol(O n ) = 1. 

Obviously, 

volteJLiP^Ctej) =p~ 

We also normalize the volume in any linear subspace V C K n by the condi- 
tion 

V0ly(0™ n V) = 1. 

1.4. Spherical functions on GL„(K). Denote by B n the group of all 
upper triangular n x n matrices over K, the group B n is the stabilizer of the 
flag 

= K° C K 1 C ■ ■ • C K™- 1 C K n . 
Denote by Fl„ the space of all flags 

V : = V C Vi C V 2 C • • • C V n -! <zV n = K n - where dim V 3 = j, 

in K"; the space Fl„ is the homogeneous space GL„(K)/B„. This space is also 
homogeneous with respect to the compact group GL„(0); hence there exists a 
unique up to a scalar factor GL„(0)-invariant measure dV on Fl„. We assume 
that the total measure of Fl„ is 1. 

For an element Vj of a flag V, consider the natural measure voly^ on Vj and 
the natural measure vol^. on gVj. Consider also the image g ■ voly^ of voly^ 
under the map g. Thus we have two measures on gVj, denote by aj(g; V) their 
ratio, i.e., 

9 ■ vol Vj (Q) = a,j (g; V) vol gVj (Q) 

for each subset Q c gVj. 

Obviously, these numbers (multipliers) satisfy the identity 

07(5152; V) = a j (g 1 ,g 2 V)a j (g 2 ;V). (1.5) 

The Radon-Nikodym derivative d{gV)/dV of the transformation V 1— » gV is 

d(gV) _ A/ aj (g;V) 



dV 



nr^^r (1.6) 



Fix complex numbers Ai,...,A„. Consider the representation T\ of the 
group GL n (K) in the space L 2 (F\ n ) defined by the formula 



n-1 

l)/2-A„ _ 



Tx(g)f(V) = f( 9 V) • J] aj (g; V )-^+^ . a n (g;V)^ 



3=1 



0=1 
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(we assume ao = 1). It is a representation, since (1.5). If Xj = isj are pure 
imaginary, then T\ is unitary in L 2 (this follows from (1.6)). 

The representations T\ are called representations of the nondegenerate prin- 
cipal series. For imaginary Xj — isj, they are called representations of the 
nondegenerate unitary principal series. 

Let o~ £ S n be a permutation of (Ai, . . . , A„). For pure imaginary Xj = isj, 
we have 

T a \ ^ T\, 

the same is valid for generic A £ C". 

Denote by 1 the function /(V) = 1 on Fl„. The spherical function <p\(g) is 
defined as the following matrix element of the representation T\ 

Fl„ 3-1 

where g £ GL„(K). 

Spherical functions are GL„(CD)-biinvariant in the following sense 

¥>\(9) = ¥>\(high 2 ), where g £ GL„(K), h 1 , h 2 £ GL n (0). (1.9) 

Indeed, 

<P\(h ig h2) - (T x (h ig h 2 )l,l) = <TA(s)T A (ft2)l,IX(/ii)l) = (T\(g)l, 1). 

These functions are symmetric with respect to permutations of the param- 
eters Xj 

<p<r\(g) = <p\{g), ° s s n - 

Also for each vector 

v = gi(l 1 ,...,l n ), lj£l, (1.10) 

we have 

V\+v(g) = f\(g)- 

Indeed, the factors a,j in (1.8) satisfy log p a,j £ 7L. 

Thus, the spherical functions ip\ are parametrized by the quotient set 



of C™ by the group generated by permutations of the coordinates and shifts by 
vectors (1.10). 

We have defined a spherical function ip\ as a function on GL n (K). By the 
biinvariance (1.9), we can consider it as a function on Lat„ = GL„(K)/GL„(0) 
or as a function on the double cosets ^3+ = GL n (0) \ GL n (K)/GL„(0). 
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1.5. Spherical functions as functions on GL„(0) \ GL„(K)/GL„(0). 
An explicit expression for the spherical functions as functions on was ob- 
tained in UJ, see also [7J, formula V.(3.4): 

...,*»)= a- pE(C"+i)^ 2 ^ ^ n p "^7r p "-A A r » 

<reS„ m<Z 1 y 

(1.11) 

where the summation is taken over all the permutations a of the set {1, 2, . . . , n} 
and the constant A is 

n?=i(i-p-o' 

Remark. Thus, the expression (^(k) for a fixed k is a Hall-Littlewood 
symmetric function (see [7] , Chapter III) as a function in the variables Zj = p Xj . 

1.6. Spherical functions as functions on Lat n . A spherical function ip\ 
on Lat n has the following integral representation 

/n— 1 
H vol((hR) nW) 1+Xj ~ Xj+1 • vo\{hR)-( n -^! 2+Xn dh, (1.12) 

GL„(0) 3 = 1 

where dh is the Haar measure on GL ra (O) ; we assume that the total measure of 
GL„(0) is 1. This follows from (1.9): since the Fl„ is a GL„(0)-homogeneous 
space, we can replace the integration over Fl„ by the integration over GL n (0). 

Next, we replace the integration over GL„(0) in (1.12) by the average over 
GL„(0)-orbits 

1 n — 1 

^ A (i?) = _L y TT voifiz n w) 1+x 3- x i+i , V0 ^^-(n-i)/2+A„ (113) 

v y fleo[k] j=i 

where i/(k) is given by (1.4). 

1.7. Spherical functions as invariant kernels on Lat„. Let L(R,S) be 
a function on Lat„ x Lat n invariant with respect to the action of GL n (K), i.e., 

L(gR,gS) = L(R,S), for R, S G Lat„, g G GL„(K). 

Then 

£(5) :=L(O n ,5) 

is a GL„(0)-invariant function on Lat n . Conversely, having a GL„(0)-invariant 
function I on Lat„, we can reconstruct the corresponding GL„ (K)-invariant 
kernel L(R, S). 

Let us apply this remark to the spherical functions and define the spherical 
kernel $\ (R, T) on Lat„ x Lat„ by the formula 

$ x (gO n ,hO n ) := tpxig^hO*). 
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1.8. Spherical transform. Let / be a GL„(0)-invariant function on Lat n . 
Its spherical transform is the function / in variables Xj defined by 

7(A lf ...,A„)= <P-M,...,-x n (R)f(R)- (1-14) 

If we consider / as a function on *}3+ , we write 

/(A 1 ,...,A n )= "( k )v-A 1 ,...,-A B (k)/(k). 

Since f(R) in (1.14) is a constant on any GL„(0)-orbit, formula (1-13) allows 
to convert (1-14) to the form 



n— i 

/(A 1) ...,A„)= /(i2)[lI voI ( i2nKJ ') 1+A, ~ A ' +1 - vol (i2)~ (n - 1)/a+ - V - 

-RGLat„ j=l 



(1.15) 

1.9. Plancherel theorem. Macdonald's inversion formula for the spheri- 
cal transform (see [HJ) is 



f(R)= j f(isi,---,is n )tp isil ... tiSn (R)dfj,(s), (1-16) 

0^Sj^27r/ lnp 

where the Plancherel measure dfi(s) is 



n ts k isi 



2 



Ms)=C-H\ p l_ p P 1+isi d Sl ...ds n (1.17) 



k<l 

and the constant C is 

ln> " l-p-3 



C = 



(27r)"n! JJj 1 - p 



Also the following Plancherel formula holds 

£ l/(k)| 2 Kk)= J \f(is)\ 2 dv(s). 

ke^i 0<S;j<27r/lnp 

1.10. Explicit spectral decomposition of ^ 2 (Lat„). Denote by S n the 
simplex 

< si < ... < s„ < 27r/lnp. (1.19) 

Equip this simplex by the Plancherel measure n\dfj,(s), where dfi(s) is given 
by (1.17). Consider the space S„ x Fl„ equipped with the product-measure 
dfi(s) x dV. 
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The group GL„(K) acts in the space L 2 (E n x Fl n ) by the unitary operators 
,( 9 )*(,,V) = .(.,,V) . n(J^)- ( " +,, ' 2+i -'''. ,1.20) 

This formula defines the direct multiplicity-free integral of unitary representa- 
tions of principal nondegenerate series. 

For a function f(R) on Lat„, we define the function Jf(s, V) given by 

n-l 

Jf(s,V)= f( R )-Y[ vol(RnK i ) 1 ~ Ul+i ' i+1 -wl(R)-( n - 1 V 2 - u «. (1.21) 

-RGLat„ j = l 

It can easily be checked, that the operator J intertwines representation of 
GL„(K) in l 2 (Lat„) and the representation p. Also, the operator J is a unitary 
operator 

; 2 (Lat„) -> L 2 (S„ x Fl n ,rf/x(s) x dV) 
(this is a rephrasing of the Plancherel formula for the spherical transform). 
2. Results 

2.1. Beta-function. Consider the flag 

= K° C K 1 C • • • C IK"" 1 C K". (2.1) 

Consider the lattices O j = K j n O™. Thus we obtain the flag of O-modules 

= O c O 1 c • • • c O™- 1 c O™. 

Fix complex numbers ot\ , . . . , a n , [3\ , . . . , (3 n such that 

Re fa + j - 1< 0, Re a,- + Reft - n + j > 0. (2.2) 

Let also a n+1 = (3 n+1 . 
Theorem 2.1. 

n 

n{ vol ( i?nKJ ) ft ~ ft+1 vol(i?nO J )"^^ +1 } = (2.3) 



_RGLat„ j=l 



1 - p-( a J- n +i) 



n _p^+j-i)(i _p-(«j+ft-n+j))- ( 2 - 4 ^ 

Remark. The condition of the convergence of this series is (2.2). 
2.2. Deformation of l 2 - Fix ad. Let R, S range in Lat„. Consider the 
kernel 

K(RS] - v°KRnsr 
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Theorem 2.2. a) Let 

a = 0, 1,2, ...,n-l ora>n-l. (2.6) 

Then there exist a Hilbert space H a and a system of vectors e R e H a , where R 
ranges in Lat n , such that the scalar products of e R have the form 

(e R ,e s )=K a (R,S) (2.7) 

and linear combinations of the vectors e R are dense in H a 

b) If a is outside the set (2.6), then a Hilbert space H a does not exist. 

Remark. The space H a is unique in the following sense. Let H' a be another 
Hilbert space and e' R G H' be another system of vectors satisfying the same 
conditions. Then there exists a unitary operator A : H a — ► H' a such that 
Ae R = e' R for all the lattices R. 

Remark. The space Ho is one-dimensional, all the vectors in this case 
coincide. 

The group GL„(K) acts in the space H a by the unitary operators 

U a (g)e R = e gR . 
Remark. Let a — ► +oo. Then 



lim K a (R,T) = 



1, if R = T; 
0, if R ^ T. 



In this sense, the limit of H a asa-> +oo is the space /2(Lat„). 

2.3. Plancherel formula for the spaces H a , a > n — 1. The following 
theorem gives the explicit spectral decomposition of the space H a with respect 
to the action of GL„(K). 

Theorem 2.3. For a > n - 1 we have 



K a (R,T) = J <!-,, , ;//.'/ :• d/i a (s), 



(2.8) 



where the spherical kernels $ were defined in 1.7, the integration is taken over 
the cube (torus) Sj G [0, 27r/lnp], and the Plancherel measure \i a is given by 



dn a (s) = C JJ(1 - p-^- 1 ) Yl |l - p-(«-«+i)/ 2 



x 



X 



n 2 ^i---^ (2.9) 



where 



c = ln"p -pr 1 -p J 
(27r)"n! 1 -p" 1 ' 
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2.4. Plancherel formula for a = 0, 1, . . . , n — 1. 

Theorem 2.4. Let a = 0, 1, . . . , n - 1. TTien 

K a (R,T)= / 

^isi ,...,is a , — (n— a+l)/2, — (n— a+l)/2+l,...,(n— a+ 

where Sj £ [0, 27r/lnp] ; the Plancherel measure is 

d„ a (s)=c a f[\i- P ^- a -^ 2+ ^ 2 n 

and 



dsi . . . ds a , 



C„ — 



ln> 



(27r) Q (n - a)! 



(i-p- 1 )- 01 !!^-^"*) n a-*"*)- 



k=n—a+l 



2.5. Spectra. 

Proposition 2.5. Spectrum of each representation U a of the group GL n (K) 
m iJ Q is multiplicity-free. 

Now we intend to describe the spectra explicitly. 
Consider the flag 

K 1 C IK 2 C • • • C K k 

in K n . Denote by Pk the stabilizer of this flag in GL„(K). It is the group of 

block (1 + H h 1 + (n - k)) x (1 + 1 + h 1 + (n - fc)) upper triangular 

matrices 



/an a 12 
a 2 2 



V 



a ik a i(k+i) 
a2k a 2 (k+i) 



a kk a k(k+l) 

a(fc+i)(fc+i) 







a n(k+l) 



0-ln \ 
0-2n 

O'kn 
a (k+l)n 

a nn J 



In particular, P n = B n is the group of all upper triangular matrices. 
The spectrum is the support of the Plancherel measure, hence Theorems 
2.3-2.4 imply the following corollary. 

Corollary 2.6. a) For a > n — 1 the spectrum consists of all spherical 
representations o/GL„(K) of the unitary nondegenerate principal series 

b) For a = 0, 1, 2, . . . , n — 1 the spectrum consists of representations of 
GL„(K) unitary induced from the characters 



X s (A) = Y[\ ajj r, 



^ si < . . . ^ s a < 2ir/ Inp 
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of the group P a . 

Remarks, a) For a = n — 1 the spectrum consists of representations T is of 
unitary nondegenerate principal series such that s n = 0. 

b) For a = n — 2, n — 3, . . . the spectrum consists of degenerated unitary 
principal series. In notation of §1.4, consider the subspace Y a c L 2 (F1„) of 
functions that do not depend of the terms Ki-a+iv • • , V n -i 01 a na g V G Fl„; 
evidently, Y a ~ L 2 (GL„(K)/Pj.). It is clear that for our values of the parameters 
of the representations, the subspace Y a is GL„-invariant. This gives a realization 
of our representations in L 2 (GL n (K) / Pk) . 

2.6. A realization of the system e_R. For definiteness, let a > n — 1. 
Then ff Q is equivalent to a direct integral of representations of principal series. 
Here we write explicitly the image of the system e# in this direct integral. 

Let the simplex S„ be the same as above (1.19). Equip this simplex with 
the Plancherel measure n\dfi a , see Theorem 2.3. Consider the space S„ x 
Fl n equipped with the product-measure nld/j, a x dV and the space L 2 (E n x 
Fl„) with respect to our measure. The group GL„(K) acts in the space L 2 
by the unitary operators p a (g) given by the formula (1.20); the formula for 
the operators themselves does not contain a, but the space of a representation 
depends on a. 

For a lattice R, we consider the function u R (s, V) on S„ x Fl„ given by 

n-l 

Ur(s,V) - J[ vol(i?nl/ J ) 1 -^ + ^+ 1 •vol(i2)-( n - 1 >/ 2 -"». 

Our Plancherel formula implies the following corollary. 
Theorem 2.7. For each R, T e Lat„, 



(mji, us) 1,2 (H n x fi„ ) = / Mi?(s, V)u T (s, V)n!rf/i Q (s)dV = 

H„xFl„ 

= (en,es}H a = K a (R,T) 

Remark. Denote by Macdonald's Plancherel measure (1.17) on S n . 
The system ur(s,V) is an orthonormal basis in the space L 2 (E n x Fl„) with 
respect to the measure /Xqo x dV: 



J u R (s,V)u T {s,V)nldfj, 00 (s)dV = 

S„xFl„ 

2.7. Linear dependence. Let a = 0, 1, 2, . . . , n — 1. In these cases, the 
space is smaller than for a > n — 1 (first, the support of the Plancherel 
measure has lesser dimension; second, the representations in the spectrum are 
'smaller'). For these values of a the vectors e_R are linear dependent. 



1, if R = T 
0, if R ^ T 
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Theorem 2.8. Let R C S be arbitrary lattices such that S/R ~ (Z/pZ) a+1 . 
Then 



a+l 

E 

k=0 



(_l^ p k(k-a-l)/2 



QGLat,, 



RCQCS.. S/Q2 



en 



(2.10) 



2.8. Remark. Relation with the Weil representation. Consider 
the Weil representation (see m>|, see also explicit formulae in [8]) of the group 
Sp(2n,K) and its restriction a to the subgroup GL(n,K). The representation 
a is equivalent to the natural representation of GL„(K) in the subspace L 2 + C 
L 2 (K") consisting of even functions, i.e., f(—x) — f(x), by the formula 

<r(g)f(x) = figx^detgl 1 / 2 ; g e GL(n, K), x E K n . 

In particular, the representation a is single- valued (the Weil representation itself 
is double- valued). 

Denote by £ the Sp(2n, 0)-fixed vector in the Weil representation. The 
'vacuum vector' £ corresponds to the function f(z) defined by: f(z) = 1 for 
z e O™ and f(z) — otherwise. 

Consider all the possible vectors U(g)^, where g ranges in GL„(K). We have 
U{gh)(; — U(g)^ for any h 6 GL„(0) and hence the vectors of the form U(g)^ 
are enumerated by points of GL„(K)/GL„(0) = Lat„; we denote the vector 
corresponding to a lattice R by £r. 

Proposition 2.9. (£ R ,£ S ) = K^S). 

This is trivial but important. We observe that 

K a (R,T) = \(Z R ,ts)\ a 

In the real case, exactly this procedure gives the Berezin kernels. Thus, this is 
a way to conjecture a form of 'Berezin kernels' in the p-adic case. 

The most serious a posteriori argument for our analogy is the formula 
(2.9) for the Plancherel measure, since it can be obtained from the formula over 
IR (see ^J) by replacing of the usual T- functions by their p-adic analogs. 

2.9. Remark. Realization of H a in functions on Lat„. For each 
h G H a , we assign the function //, on Lat ra by the formula 

fh(R) = (h,e R ) Ha . 

Thus we realize H a as some space of functions on Lat ra . After this, it is possible 
to apply the usual formalism of reproducing kernels, see, for instance jllj. we 
do not discuss this here. 

For a = 0, l,...,n — 1, relations (2.10) become difference equations for 
functions ft', for each lattices R C S satisfying S/R = (Z/pZ) Q+1 , any function 
fh satisfies 



a+l 

E 

k=0 



p k{k-CL-l)/2 



E m r ) 

QeLat„: flcQCS, S/Q~(Z/pZ) fc 
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These equations are the analog of the determinant systems of partial dif- 
ferential equations defining the degenerated Berezin spaces, see, for instance 

El 

2.10. Remark. Additional symmetry. For each element a = (01, . . . , a n ) € 
K™ we define the linear functional 

£ a (z) = a\Z\ H 1- a n z n . 

Let R be a lattice in K™. We define the dual lattice i? v as the set of all a € K™ 
such that £ a {z) e O for all z 6 R. 

Lemma 2.10. K a (R v , S v ) = K a (R, S) 

Proof. This follows from 

i? v nS v = {R + Sy, vol(i? v ) = l/vol(i?), 

vol(R + S) vo\(R nS)= vol(i?) • vol(S) □ 

Hence the map en esy defines the unitary operator in the space H a . 

Obviously, for g G GL n (K), R <E Lat„, we have (gR) v = (,g t )~ 1 i? v , where * 
denotes the transposition of matrices. Thus, we obtain the canonical action of 
the semidirect product (Z/2Z) K GL„(K) in the space H a . 

Remark. In the Weil representation (see above §2.8), the operator e_R i— > 

e/jv corresponds to the matrix ^ ^ ^ € Sp(2rn,K). In the L 2 (K")-model of 

/7i (see §2.8, or more generally U m , see below §6.1) it corresponds to the Fourier 
transform. 

Theorem 2.8 and the structure of the Planchercl formula in Theorem 4.4 
(see below) also are consistent with this symmetry. 

2.11. Remark. Identities with Hall Littlewood functions. Let p be 

real, p > 1. Define the functions (^^(k) = ^(k) by the formula (1.11). For 
prime values of p these functions are spherical functions over K = Q p . 

PROPOSITION 2.11. a) The identity (2.8) holds for arbitrary p > 1, a > 
n-1. 

b) For arbitrary p > 1 and sufficiently large real a, 



^ (k) P -^ i fc ^(k) = n a - p- a+i ) n i 1 

k 1=0 j=l 



p-(a+n-l)/2+isj 



-2 



where i^(k) is given by (1-4). 

2.12. Remark: the Tamagawa zeta-function. Assume in Theorem 2.1 

atj = t, (3j = 7 3 - t. 

Passing to the limit as t — > +oo, we obtain 
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Corollary 2.12. 

n n 

JJvoi(jenK i ) 7,-7,+1 = Y[0--P~^ i ~ n ~ s )~ 1 - 

iieLat„,i?,CO" j=l j=l 

This is the Tamagawa zeta- function, see [7], IV. 4. 

2.13. Remark. Lattices in Q n and classical zeta-function. Consider 
the n-dimensional space Q n over the rational numbers. A lattice in Q™ is a 
free Z-submodule with n generators. We denote the space of lattices in Q™ by 
Lat n «J). 

For a lattice R C Q™, we denote by v n (R) the volume of the torus M. n /R. 
Denote by e\, . . . , e n the standard basis in Q n , Denote 

Q k = Qei © • • • © Qe k , Z k = Zei © • • • © Ze fc . 

Fix complex ai, . . . , a n and . . . , /3„; assume a„+i = 0, = 0. Let 

Reay — n + 1 > 1, Re a, + Re /3j — n + j > 1, Re /3j + j < 0. 

Theorem 2.13. 

n 

II n Q fc )^ +,3fc+1 vfc(i? n z k )~ a "+ ak + 1 = 

i?6Lat„(Q) J=l 

_ TT CHft + j - 1))CK + ft ~ n + j) 

C( aj -n + j) " 



3=1 

where 



1 i—i 



m 

m— 1 p 2S prime 

is the zeta-function. 

3. Calculation of the beta-sum 

Here we prove Theorems 2.1 and 2.13. 

3.1. Transformation of the beta-sum. Denote by Lat n _i the space of 
lattices in the subspace C We transform the expression (2.3) to the 

form 



n— 2 

e n 

_R'SLat„_! j=l 

x vol(i?' n W 1 - 1 ) 13 — 1 vol(R' n O"" 1 )"— 1 x (3.2) 



jvol(i?' nPf'-^ +1 vol(R' nO J ) a ^ +1 }x (3.1) 



x 



^ r vol(-R)&* vol(i?nO") Q - -i 

ReLat»: RnK™- 1 =R' 



(3.3) 
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Lemma 3.1. The interior sum (3.3) is equal to 

0~n 



voKO"- 1 ni?')' 

where 



1 - «~ Q " 

(3.4) 



(1 -p-«n-/3n)(l _p/3n+n-l)' 

Lemma 3.1 will be proved below. 

Corollary 3.2. Denote by F n (a;(3) the left hand side of (2.3)-(2.4). T/ie 
following identity for F n (a; (3) holds 

F n (a!, ... ,a n ;/3i, ...,/?„) = <7„.F n _i(a!i, . . . , a„_i - . ,/3„_i), 

where a n is given by (3.4). 

This corollary implies Theorem 2.1. 

3.2. New variables £ and ^. Consider the subspace K" _1 C K". We 
have IK™ = K"" 1 ©Ke„. 

Fix a lattice i?' C K" _1 . Let R satisfy the property 

RDK 11 - 1 = R'. (3.5) 

Each vector r in R has the form r = ap k e n + v, where v £ K n_1 , \a\ = 1. 
Lemma 3.3. Denote by £ the minimal possible k, let h — p^e n + v £ R. 
Then 

R = R' ®Oh = R' ®0(p 6 e n + v). (3.6) 

This is obvious. The next Lemma is equivalent to Lemma 3.3. 

Lemma 3.3'. Consider the natural map it : K n — > Ke n . Let h £ R and n(h) 
generates the O-module ir(R). Then R = R' © Oh. 

Lemma 3.4. Lattices R x = R' © 0(p €l e„ + vi) and R 2 = R' © 0(p ?2 e„ + w 2 ) 
coincide iff ^i = v\ — v 2 £ R' ■ 
Proof is obvious. 

Thus a lattice R with the property (3.5) is determined by the integer £ = 
£(i?) and an element v = v(R) of the quotient group K™ _1 /i?'. 

We also define a nonncgative integer v = v{R) by the condition 

- if v £ R' + CD"" 1 , then v = 0; 

— otherwise, v is the minimal k such that p k v £ R' + O n_1 . 
Lemma 3.5. 

vol(fl) _ 6 



vol(-R') 

voi(i?no™- n 
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PROOF. The statement a) is obvious. The statement b) is a corollary of the 
following lemma. 

Lemma 3.6. Let R has the form (3.6). Then R n O" has the form 

R n O" = R' 8 Q[p"(pte n + v )+w], 

where k = max(^, — £) and w G — p*v + R' . 
Proof. First, 

P*(p ( e n + v)+w eR' ^> x^O, w G R' (3.7) 

Secondly, 

P*(p S e n +v) + w G O" x ■ L 0, p"v + w G O™" 1 (3.8) 

Since w G R' , p"v + w G O"" 1 , we have p"v G R' + O"" 1 . But k > 0, hence 
x > za Also, x ^ — £, sec (3.8). It remains to apply Lemma 3.3-3.3'. □ 



Lemma 3.7. The number of lattices R G Lat„ satisfying (3.5) with given 

1 

voi^'no™- 1 )' 
p i/ («- i )(i _ p-™+ 1 ) 



k voi^'no"- 1 ) ' 



v = 0; 
i/ > 



PROOF. Nothing depends on £. We must find number of vectors v G 
W^/R' such that p^w G (R' + <Q n - 1 )/R l . 

The index of R' in + O"" 1 is l/vo\(R' n O™" 1 ). It remains to find the 
number u* n {v) of u G IK"- 1 /(i?' + O™" 1 ) such that ^ G R' + O"" 1 , since we 
have 

/ ti _ <(^) 

Un[v ^> ~ voi^'no"- 1 )' 

For each lattice S C K™ _1 , the additive group IK™ -1 /,? is isomorphic to 
(K/O)™ -1 . Hence we must find the number of solutions of the equation p v v = 
in (IK/O)"- 1 . 

The additive group K/O is the inductive limit of the cyclic groups 

K/O = lim Z/p k Z. 

k — >oo 

Hence the number of solutions of the equation p v v = in (K/0) n_1 is p 1 ^™ -1 ). 
But of these solutions are also solutions of the equation p"~ 1 v = 0. 

If v — 0, we have a unique solution v = 0. □ 

3.3. The end of calculation. Lemma 3.5, 3.7 reduce an evaluation of 
(3.3) to an evaluation of the sum 

vo i(R'no^)^^ p p n[, V 
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Here the summation amounts to summations of several geometric progressions. 

3.4. Proof of Theorem 2.13. Let Q p be p-adic numbers, O p be p-adic 
integers. For each prime p consider the natural embeddings Q — ► Q p , Q" — » Q™ 
and the induced map 

tt p : Lat n (Q) -> Lat„(Q p ), 

i.e., for R £ Lat„(Q) we consider its closure in Q™. 

Our calculation is based on the following two remarks. 
First, for any R £ Lat„(Q), 



V n (R)~ 1 = J] VOlQ.(7T p (i?)). 



p is prime 

Secondly, the map 

R^ (Tr 2 (R),Tr3{R),TT 5 (R),7T 7 (R),TT 11 (R), . . .) 

is a bijection of Lat„(Q) and the set of sequences (52, 5 3 , 5 5 , Sj, 5n, . . . ) such 
that S p £ Lat„(Q p ) and S p = O" except finite number of p; see ^7], Theorem 
V.2.2, 

Hence the left hand side of (2.11) transforms to the form 

n 

p is prime S p GLat„(Q p ) j=l 

It remains to apply Theorem 2.1. 
4. Plancherel formula 

This section contains proofs of Theorem 2.3 (in §4.1), Theorem 2.4 (in §§4.2— 
4.6), Proposition 2.5 (in §4.7), Theorem 2.7 (in §4.8), Proposition 2.11 (in §4.9). 
We also obtain 'indefinite Plancherel formula' (Theorem 4.4), which is used 
below in §5. 

4.1. Plancherel formula. Consider the GL„(0)-invariant function 

volf R n o n ) a 

A a (R) = K a (O n , R) = vol{R)a /2 ■ R e Lat »- 
By (1.15), its spherical transform is 

_R£Lat„ ^ ' j'=l 

(4.1) 

By Theorem 2.1, it equals 

1 — n~( a ~' n +i)"] 



7 = 1 V 



■n+ 



l)/2+A j )( 1 _ p -{ a -n+X)/2-X j )y 
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Applying the inversion formula (1.16) for the spherical transform, we obtain 
Theorem 2.3. 

4.2. Plancherel formula as a contour integral. Introduce the new 
variables Zk — p lSk ■ Also introduce a new notation for the spherical functions 

ip[zi, ...,z n ;R] := <Pi Sl ,...,is n (R)- 

Now Theorem 2.3 is converted to the form 

A a (R) = C a I , (4.2) 

where Io is the following integral over a torus 

- n 1 

l0=I (a;R)= J II (z p (a-n + l)/2 )( - (a -n + l)/ 2) X ^ 
| Z1 | = 1,...,|» B | = 1 3 ~ 1 

x II 7 ( ^7 Z;)2 I r #i,..,^;fi]^i-^ (4.4) 



and the constant Co is 



Co=C (a) = IlTzf=r na-P"^) («) 

The function A a (R) is a holomorphic function in a £ C. The integral 
expression Co/o f° r A a (i?) is holomorphic in the domain Re a > n — 1. We 
intend to obtain the holomorphic continuation of Co(a)Io(a; R) into the whole 
plane q£C. 

4.3. Analytic continuation to the strip n — 3<Reo!<n — 1. Denote 

/? := (a - n + l)/2, (4.6) 

U^i.-^m) := II 7 ^\ ^ -i x (4-7) 

It can be easily checked that ^ m is symmetric with respect to Zj . Recall also 
that the spherical functions are symmetric with respect to Zj. 
Lemma 4.1. For n - 3 < Rea < n - 1, 

A Q (i?) = Co 7 + n Coi (/ + i + Vi) + "(« - 1) Ci A. ( 4 -8) 
w/iere Co, h are the same as above (4.3)-(4.5), 

n-l a 



n-l 



/+ = / TT flZZ. 

7 fj^-^x^-^-^-p- 



(4-9) 



1^1=1,.. ..IZn-iHl J 



X 



/x„_i(zi, . . . , z„_i) ^[zi, . . . , z„_i,p' 3 ; R\ dzi. .. dz n -i 
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Fig 1. 





\zi\ = l/p 


«ll=l 


lzll=p 





\ p-^ 


/ 




1 







a) The poles zi = p ±/3 of the integrand 7 for /3 > and their motion for decreasing 
/?. If z 2l . . . , 2„ are fixed and |z 2 | = • • • = \z n \ = 1, then all other poles (with respect 
Z\) lie on the circles \z\\ = p^ 1 , \zi\ = p. 



, pf- 1 




p /3+l 


1 


1 







b) The poles of the integrand h for > /3 > — 1. The /3 decreases. 



\ 

1 f 




\ p"" +1 


1 







c) The poles of the integrand I Q1 for > (3 > — 1. The /3 decreases. 
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z 01 



,. n— 1 

/ H 



p 



-0 



i» 1 |=i,...,i* B _ 1 |=i 



(4.10) 



x/z„ 



-i(zi, . . . , z n --i) tp[zi, z n -!,p ; R] dzi... dz n -i, 



y t\ {z j - P -^){z j -^){z j - P ^)( Zj -p-0+i) 
i zl i=i,...,i Zn _ 2 i=i 

(4.11) 

X/i n _ 2 (-Zl, . . . , z„_ 2 ) ■ • • , -.P^] R] dz 1 ... dz n -2, 

and the constants are given by 

2mC Q 



Coi — 



p - p-0 ' 



C 1 = p - 2fJ (l-p- 2f3 - 1 )- 1 {l- p - 2f3+1 )- 1 {2T:i) 2 C i} . 
r± 

'/,/ 

Proof. First, we expand 



We denote the integrands in Ik, Ij^, see (4.9)-(4.11) and Theorem 4.4 below by 



n n 

n ? — w — = ^-fvnf^T — ^) ( 4 - 12 ) 

and open brackets. The integral (4.3)-(4.4) splits into the sum of 2" integrals 
and it is sufficient to construct the analytic continuation of each summand. 
For dcfinitcncss, consider the summand 



N(0) :-- 



1 



{zi-pP)... (z s - P P){z s+1 - p -0)...( Zn - p -0) 
| Zl |=i,...,| z „|=i 



x Hn{zi, ...,z n ) <p[z lt ...,z n ;R]dz 1 ... dz n ; 



by symmetry considerations, we do not lose a generality. Denote the integrand in 
N(/3) by 9T(/3; z). The analytic continuation of N((3) through the line Re/3 — 
is given by the same integral over another contour 

N = 1 -e, \z s \ = 1-e, |z s+ i| = 1 + e, \z n \ = 1 + e. (4.13) 

Consider the family of contours L , . . . L„, where L m is given by 

r | . J 1 ' if .?^ m > 

1 ± £ if j > m, 
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and the signs ± are the same as in (4.13). In particular, L n is the torus \z\\ 
■ ■ ■ = \z n \ = 1, and L is (4.13). 
Then 



Li 



+ ... - + • (4.14) 



Each bracket can be evaluated by one-dimensional residues. In the last bracket 
wc obtain 

n-1 

res Zn=p -n m(p;z)l[dz j , 

'|«l| = - = l«n-l| = l j = l 

here we obtain a desired expression. 

For other brackets the picture is more complicated. For instance, in the first 
bracket we obtain 



/it 
res Zl=p( 3 Vl(P;z)]ldz. 



3=2 



where the integration is taken over the torus \z2\ = 1 — £, \z n \ = 1 + s. 
For this torus we apply the transformation of (4.14) type, etc., etc. Thus we 
obtain 2" summands having the form / res res. . .res. However, fi n (z) = on 
the hyperplanes Zk = zi, and hence 

res res 9t(/3, z) = 0, res res 9t(/3, z)=0 

Hence 

/ - / = - V / res m + V / res m - V / res res DT, 

where integrations are taken over tori \zi\ = 1. Next, we transform this sum to 
the form 

V / res res 9t(/3; z) TT dz m (4.15) 

(all the 'new' summands equal zero). 

Adding together all the 2™ summands of the integral Iq , we obtain an expres- 
sion of the form (4.15), only 9T is replaced by the integrand 3q of Io- Evaluatiing 
the residues and applying the symmetry of the spherical functions with respect 
to zj, we obtain (4.8); the symmetry with respect to Zj is the origin of the 
coefficients n, n(n — 1) in (4.8). 

4.4. Plancherel formula at a = n — 1 and a = n — 2. 

Proposition 4.2. 



A„_ 2 (i?) =n(n-l) [CiJi] 



a— n — 2 
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Re a— 






Re ct— 




Re a— 


Re a— 




=n-7 






— n — 5 




=n-3 


=n-l 




/o 






/o 




/o 


/o 




\h, 






j/l, 




j-fr; ^oi 






\I 2 , 


^1. 


r± 

J 02 




J m J 02 








\h, 
— i 


T± 
1 2H 


r± 

J 12> 


i 03 i 
i 




i • — 


1 


1 



^3i ^3 ^ h In h !m 

Fig 2. The summands of the Plancherel formula in different strips. The summand 
of the Plancherel formula surviving at the points a = n — 1 — m^O. 



PROOF. For a = n - 2 we have C = C i = in (4.8). This gives the 
required result. 

Proposition 4.3. 



Vl(fl) - ^ [Coi (/ + ! + Vl)] 



a— n — 1 



PROOF. For a = n— 1, the both formulae (4.2) (4.8), are not valid. Consider 
the new function 

(where (a — n + \)/2 = (3). The factor 2(3 In p/ Co {(3) is a holomorphic nonvan- 
ishing function near the point (3 = and hence it is sufficient to find an integral 
expansion for h(0, R). We have 



h(0,R) = 



1 
2~7ri 



MM 

/3 



d(3 



for each sufficiently small p. We transform this expression to the form 
21np 



h(0,R) 



2ni 
+ 



Io(/3)d/3+ 



21np 
2m 



n ■ 2-ki 



+ 



\/3\=p, Re/3<0 

n(n- l)(27ri) 2 , -| , 

+ 2 p2 f){l _ p -2^-l )(1 _ p -2/3+l ) / l(/ ? )J ^ ( 4 - 16 ) 

First, the function 7o(/3) is even, i.e., lrj(/3) = Iq{—(3), sec (4.3). Hence, the 
first term in (4.16) vanishes. 
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Secondly, ii(0) is finite, and the corresponding scalar factor is finite at /? = 0. 
Hence the last term of (4.16) tends to zero as p — > 0. 
Thirdly, let us evaluate 



/ ^^ I ^ UUU (4 - 17) 

|/3|=/9,Re/3<0 



In formula (4.9), was defined as an integral over the contour \z\ = ■ ■ ■ = 
\z n -\ — 1. We can replace this contour by M : \z\\ = ■ ■ ■ = |z n _i| = 1 + e, and 
Jm^oi * s holomorphic in the strip |Re/3| < e. This allows to transform (4.17) 
to the form 

J lim J 2 ^ n ^_ fj 3~oi(P, z) d(3 dz\... dz n _i = iri J Jp^O, z) d(3 dz\ . . . dz n -\- 

M |/3|=p, Rc/3<0 M 

This implies the required result. 

4.5. Complete analytic continuation. We preserve the notation (4.6)- 
(4.7) for f3 and fj,(z) 

Theorem 4.4. Let Rea^n-l,n-3,..., — n + 1. T/ien 

A Q (i?)=C / + E 7^W Cfe/fe+ 

fc:fe^l,2(fe-l)+Rea<n-l 1 ' 

E ( n - 2 1-o! CM(ja+f " ) ' (418) 

w/iere 

, "ff te-p- /J - fc+1 )(* J --p 8+fc - 1 ) 



/ ,,S — 



p/3+ fe )(^ -p-^- fc )(z, -p^- 1 )^- -J9-/3+ 1 ) 

ki|=-=k„-2*|=i J ^ 
x <p\z u . . . , « n -2 fc) ^,^ +1 , • • • .^"V 3 -^ 1 , • • • ,p- f3+ \p- f3 - R]x 

X Mn-2fe(^l, • • ■ , Z n -2k) dZi . . .dz n -2k, 



ki j y (^•-p/ 3 + fe +ofe-p- /3 - fe )fe-p /5 - i )fe-p- /3+i ) 

|*l| = -=|*»-2*-ll = l J_1 

x . . . , ^^p^+S . . . ^^-V^- 1 , . . . ,p-P + \p-e; R]x 

X fi n -2k-l(zi, ■ • • , Z„_ 2 fc-i) dz\... dz n -2k-l 



hi 



(zj -vP + "-^){zj -p-P-*-^ 1 ) 

|«l| = - = |z„-2fc-l| = l 3 ~ 



/II — - 
n 



\ {Zj - p-P-k-^iZj -pP+ k ){ Z] -pP- l ){Zj -P-/3+ 1 ) 



x ^, . . . , , n _ 2fe _ ; ,p^+\ ■ ■ ■ ,pP +k - 1 p- f> - k - l -\ ■ ■ ■ ,p-e +1 ,p- ; R] x 

X Hn-2k-l(zi, . . • , Z n -2k-l) dZ\ . . . dz n -2k-l, 
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and the constants C'k, Cki are given by 



^ + M*-i)(i- p) » ( i-^-i) * 1 

Ofc-^TUI O - ^^2/3+2^-1 '11 (1 _pj)2(l _p2/?+j-2)2< 



C fei - (2™)<C fe 



(4.19) 

p -(P+k)l-l(l-l)/2(i _ p -2/3-2fc+l^ 1 

1 _ p-2/3-2/c-Z+l X 

' 1 

x n ^ _ p -fe-j)(i _ p -2p-k-j+2) ■ ( 4 - 2 °) 

Proof. We start from Lemma 4.1 and intend to write the analytic contin- 
uation of (4.8) to the strip | Rc/3 + 1 < e. 

First, Jo has no singularities in the half-plane Re/3 < 0. Thus we must write 
the analytic continuation of J^, Ji, see (4.9)-(4.11), to the strip | Re/3 + 1 < e. 

Secondly, the integrand 3\ of ii contains the factor 

n 



We transform this factor as (4.12), and repeat literally the proof of Lemma 4.1. 
This gives 3 new summands I2, I^, /{^ in the strip — £<Rc/3+l<0. 
Thirdly, 3^ contains the factor 



n ( z _ „/?+! 



(z-pP+^y 

all other factors of 3^ have no poles for /3 lying in our strip | Re/3 + 1| < e. 
Hence we write the analytic continuation of /qi as 

/ J^dzi . . .alz n , 

V |zi | = 1— £,..., |z n -l |=1 — e 

and evaluate the analytic continuation as the sum of residues 

j a&n^-E / ,.=p +1 ^ n 

| Zl | = ... = | z „_ l! = l i =1 J = 1 | Zl | = ... = | Z3 _ 1 | = | Zj + 1 | = | z „_ 1 | 3 l<j<n-l,j,*a 

(by the symmetry considerations all the summands of the sum X^f=i coincide). 
Other summands 

res res Ji, / r6S res res Urt-i , etc. 

Z 3 =p3+1 Z m =p0+1 7 z J =p< 3 + 1 z„ l =p< 3 +l Zs =p< 3 + 1 

vanish, since the factor fi n _i(z) is zero at the hyperplanes Zk = z m . This gives 
the new summand Iq 2 m the strip — e < Re /3 — 1 < 0. 



dzj 
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The case of I 01 is similar. 

Further, I\, Ij^ have no singularities in the half-plane Re/3 < —1. The 'new' 
summands I2, I^i, I02 have singularities on the line Re/3 = —2. Their analytic 
continuation through this line can be obtained in the same way, etc., etc. 

Now, our explicit formulae for I k , J^, C k , can be proved by induction. 
In fact it is necessary to check the identities 

Cfe+iJfe+i = 2iriC k res res 3 k ; Cfc((+i)3fea ^ = 2mC k i res 3 

4.6. Integer values of a. Proof of Theorem 2.4. Let now a = 

0, 1, 2, . . . , n — 1. In this case, the factor (see (4.5)) 



JJ (1 _ p -a+ m) (421) 



m=0 



of Co is decisive. It vanishes at all our a, and hence the summand Iq in the 
Plancherel formula (4.18) disappears. The same factor kills the most of other 
summands, since Co is present as a factor in C k and C k i- 

Theorem 4.5. Let n — a = 2k be positive even integer. Then 



±n-2k — 



(n-2k)\ 



[C k I k 



-2k 



PROOF. All other summands of the formula (4.18) vanish due (4.21), the 
summand C k I k survives, since the denominator of C k contains the factor 

1 _ p 2P+2k-l _ j _ p a-n+2k 

(see (4.19)), which also vanishes at a. 

Theorem 4.6. Let n — a = 2m + 1 be positive odd integer. Then 



n< 

" 2: ' = 2 (n - 2m - 1)! + 7 r»i( Q ))] 



a—n—2m—l 



Proof. Theorem 4.4 does not give immediate answer in this case and we 
use the same arguments as in Proposition 4.3. 

Consider the analytic continuation of our integral to the strip — m < Re/3 < 
—to + 1, or equivalently n — 2m — 1 <Rca<n — 2m + 1, it is given by (4.18). 
We must evaluate the limit of each summand of (4.18) as /3 tends to — m from 
our strip. 

First, let k < m. Then I k is holomorphic in Re/3 < — m + 1, and C k \ /3= _ m = 
0. Hence, the summand C k l k vanishes at (3 = — m. 

Secondly, let k + I < m. Then L^ are holomorphic in Re/3 < — m + 1, and 
C fe ;L = = 0. Hence C ki L^ vanish. 
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Thirdly, let k + I = m, I > 0. Then the analytic continuation of 1^ to the 
strip | Re/3 + m| < e is given by 



2l|= — =|«n- 



i|=l=Fe 



J feZ 



Hence is holomorphic in | Re/3 + m| < e. But the coefficient Cki vanishes at 
j3 = —m again. 

Thus the problem is reduced to the evaluation of lim | g_ > _ TO+ o C m I m . The 
factor C m has a simple zero at (5 = —to, and hence it is sufficient to evaluate 

lim (f3 + m)I m . 

/3^-m+0 

We represent 

(z - pf J + m )(z - p-f J - m )(z - pP-^z - P-P+ 1 ) = 

A(/3) 



+ 



a(/3) 



(z - pP+ m ){z - p-P-m) { Z -pP- 1 ){z-p-P+ 1 ) 



—y (4-22) 



where 
ACS) 



(l-p)(l-p 2/3 + 2m - 1 ) 

(1 -p m+l )(l -p2/3+m-l)' 



a(/3) 



p ( p 2/3+fc-2 _ l^gfc _ 1) 
(p2/3+fc-l _ l)(p*+l - I)' 



Let J be a subset in {1,2, ...,n — 2m}. Denote by ||J|| the number of 
elements of J. According (4.22), we represent ((3 + m)I m as a sum of 2™~ 2m 
integrals 



(/3+™)/ m (/3)=^A(/3)ll J lla(/3)"- 2m -ll J H f JJ 



1 



( 2s -^-l)(^-p-/3+l) 



(/3 + m) 



x Mn— 2m 



•/ i i > 7 (^--p /3+ro )fe-p- /3 - m ) 

=i,jeJ J £J 



(Zl, . . . , Z„_2mM- • • ; R) II dZ 3 



Y[dz s (4.23) 



Denote by F([3) — Fj((3) the expression in big brackets (it depends also on 
z s for s £ J). Denote by J the integrand in F(f3). The analytic continuation 
of F(0) can be easily written as in proof of Lemma 4.1. In the strip — m — 1 < 
Re < —m it is 

F(J3) + (J3 + m)G(P), 
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where F{0) is the same expression in square brackets (and hence F(f3) is singular 
on the line Re f3 = —m) and 



G(/?) = 27riV / [- res £ + res #1 TT dz r 

^ J L Zk =pf>+ m Zfc^p-- 3 -™ J J 

fceJ | 2j | = iforje j, 3 -#fe jeJ.^fc 

- (2«) 3 y, f .» » > n <% 



fe ^ eJ | Zj | = i for j e j, j#fe,z jeJ,j^fe,i 



Thus, 



2 ™ ./|/H-m|=p P + m 2tti J| /5+m | =p3c/3< _ m 

The transformation /3 i— > —2m — [3 preserves Fj{(3) and hence the hrst summand 
in right hand side is 0. 

The second summand gives the required result as in proof of Proposition 

4.3. 

4.7. Absence of multiplicity. Evidently, the GL„(0)-fixed vector eo™ is 
GL n (K)-cyclic. This easily implies Proposition 2.5, see proof of Lemma 1.10 in 

EI 

4.8. System eji in the direct integral. Proof of Theorem 2.7. First, 
Pa(g) u R = u gR- Hence we can assume R — O", and wq«(s,V) = 1. Thus, we 
must evaluate 

u T (s, V) dV d(x a (s) 



'Fl„ 

Integrating over Fl„ using (1.8), we obtain 

ip is {T) dfj, a (s) 

It equals K a (O n , T) by Theorem 2.3. 

4.9. Identities with Hall Littlewood functions. Let as prove the 
statement a) of Proposition 2.11. Using (1.11), it is possible to represent the 
integral (4.3)-(4.4) as a sum of residues. The result is a (nonhand) rational 
expression in p and p a . Thus the required identity is an identity of rational 
functions which holds for countable number of p (and for all a if p is fixed). 
Hence the identity holds always. 

The statement b) follows from a) and the inversion formula for spherical 
transform (the Macdonald's proof of Theorem 5.1.2 is based on calculations 
with Hall-Littlewood-type expression (1.11) and do not use primality of p). 

5. Positivity and nonpositivity 

Here we prove Theorem 2.2 on positive definiteness of the kernel K a . 
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5.1. The case a > n — 1. This follows from Theorem 2.3, since K a (R,T) 
is an integral of positive definite kernels (fri Slt ,,,^ Srl (R,T) with a positive weight 
d[i a . 

5.2. Positive definiteness of the kernel K a (R,T) for integer a. This 
again follows from the Plancherel formula (Theorem 2.4). 

More simple proof is given below in 6.1. 

5.3. The case a < 0. This case is obvious: 

(eR,e R ) = (e s ,e s ) = 1, (e R ,e s )>l. 

This is impossible. 

5.4. Noninteger a between and n — 1. Assume that the function A a 
is positive definite. Then it can be expanded as an integral of positive definite 
spherical functions ip T 

A a (R) = J ^ T (R)dx a (T) (5.1) 

with respect to some positive measure x a . 

In Theorem 4.4, we obtained some expansion 

A a (R) = J <p T (R)d<j a (r) (5.2) 

of A Q as an integral of spherical functions with respect to some measure (charge) 
<r a . For all noninteger a < n — 1, the summand ioi is present in our expansion 
with a nonzero coefficient. But the spherical function <Pi Sl ,...,is n _ 1 , n -i-a is not 
positive definite. Hence the expansions (5.1), (5.2) are different. 

It is sufficient to reduce the existence of these two different expansions to a 
contradiction. We do this in the rest of this section. 

5.5. The set £„. Denote by p the vector (n — l)/2, (n— 1)/2 — 1, . . . , — (n — 
l)/2 e K™. The symmetric group S n acts on K™ by permutations of the coordi- 
nates. Denote by Q the convex hull of .S^-orbit of the vector p. 

By E„ we denote the set of all 

r = (n,.,r B )eP/^z» 

such that each Tj is real or pure imaginary and Rer € Q. 
The set £„ is important for us by the following reasons. 

1°. If ip T is positive definite, then r S £„. In particular, the measure x a 
from (5.1) is supported by S„ 

2°. For a > 0, the measure a a from (5.2) is supported by E n . 
3°. S„ is compact. 

The unitary dual of GL„(K) is known (see [T3|, ^HDi but it is easier to 
reduce the statement 1° to Theorem 4.7.1 of 0. 

We also denote by the set of positive definite spherical functions. 



27 



5.6. Action of the Hecke algebra. The Hecke algebra H n of GL„(K) 
(see [ZD is the convolution algebra of compactly supported Gh n (0)-biinvariant 
functions on GL n (K). 

A function / on GL„(K) is called GL n (0)-biinvariant if 

f(h l9 h 2 ) = f(g) for g G GL n (K), h u h 2 G GL„(0). 

The multiplication in the Hecke algebra is the convolution. 

The Hecke algebra acts on the space of GL„(0)-biinvariant functions by the 
convolutions. 

The spherical functions ip T are the eigenfunctions of 7Y„, i.e., 

7 * cp T = c 7 (r)^ r , 7 G H, (5.3) 

where c 7 (r) is a scalar factor. 

Denote by A the algebra of all polynomial expressions of p Tl , . . . , p Tn , p~ Tl , 
. . . , p~ T ™ symmetric with respect to permutations of Tj. The map 7 1— > c 7 is an 
isomorphism H —* A, see [7|, V.3.2. 

Lemma 5.1. Lei a positive definite GL„(0) -biinvariant function f be repre- 
sented as an integral over E„ with respect to some charge 

f(9) = / ( Pr(g)da(T). 

J'Sn 

Let u(t) G A be nonnegative on E n . Then the function 

tig) = / u(r)(p T (g)da(r). 

also is positive definite. 

Proof. Since / is positive definite, it admits an expansion 

fid) = / t fr{g)dv{T). 

for some positive measure v. Let 7 be the element of the Hecke algebra corre- 
sponding to the function u(t). Then 

(7*/) (5)=/ u( T ) t Pr(g)da(T) = u{T)ip T (g)dv(T) 

The second integral defines a positive definite function, and this proves 
Lemma. □ 

5.7. Approximation of spherical functions by matrix elements of 

U a . Denote by W n the hyperoctahedral group of R", i.e., the group generated 
by permutations of the coordinates and arbitrary changes of directions of axes. 
Consider the map £„ — * M. n given by 

(n,...,r„) ^ (p^ +p- T \...,p T " +p- T ") 
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Obviously, it is constant on orbits of W n and moreover this map is an embedding 
of the quotient space T, n /W n to W 1 . 
Consider the functions 

n 
3=1 

Obviously, these functions are real on the set £„ and they separate orbits of the 
hyperoctahedral group on E n . 

Fix a point x = (is\, . . . , is n -i,n — 1 — a) E T, n . Consider the function 

n 

k=i 

The function F is zero at the orbit W n ■ x and is positive outside this orbit. Let 
M be the maximum of F on a. Consider the new function 

X(t) = M-F(t). 

It is a positive function having a maximum on the orbit W n ■ x. For simplicity, 
assume that Sj are pairwise distinct. Then the points wt are nondegenerate 
critical points of X. Let £ be the corresponding element of the Hecke algebra. 
Consider the sequence of positive definite functions 

m („-i)/2 r , Aa{g) = m (n-i)/2 J X m (T)<p s (g)d* a (T). (5.4) 
It can be easily checked, that its limit as m — > oo is 

r (#) : = c{wx)Vwx{g), (5.5) 
wew n 

where the scalar coefficients c(wx) are nonzero. This function is positive definite 
as a limit of positive definite functions. Hence r(g) can be expanded into an 
integral of positive definite spherical functions, 

r(g)= f M9)d\(T). (5.6) 

Let us evaluate the limit of £ m * r as m — > oo (now without the normalizing 
factor m^™ -1 )/ 2 ). Applying it to (5.6), we obtain 

r * r(g) = X{g) m y r {g) d\(r). (5.7) 

The orbit W n X has no intersection with the (closed) set £™, and hence the limit 
of integrals (5.7) is zero. If we evaluate the same limit using (5.5), we obtain 
r(g) (since £ m * r = r). Hence r(g) = 0. But r(g) is a finite linear combination 
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of the spherical functions, on the other hand the spherical functions are the 
eigenfunctions of the Hecke algebra. This is a contradiction. 

6. Integer values of a and difference equations 

Here we prove Theorem 2.8 on linear dependence of the vectors e#. 
6.1. Embedding of H m to L 2 (K nm ). Let m be a nonnegative integer. 
Consider the space 

K mn = f0...0K" i 
m times 

For a lattice R E Lat n , we define the lattice 



Define the function cr on K nm by the rule 



^ inn. 



\ol(R)- m / 2 , if 6»ei?" 
0, if 6 £ R n 



e R (0) = 

Obviously, the L 2 (K7"™)-scalar products of the vectors are 



(e R ,e s ) =K a {R,S) 

and hence we can identify H m with the subspace in i 2 (IK mn ) generated by the 
functions en(6). 

In particular, this proves the existence of the Hilbcrt space H m for integer 

m. 

6.2. Reduction of Theorem 2.8 to combinatorial problem. Now, let 
m = 0, 1, . . . , n — 1. 

Consider lattices R C S in K n such that S/R = {Z/pZ) m+1 . Without loss 
of generality, we can assume vol(5) = 1. 

It is convenient to identify the quotient S/R with (m+ l)-dimcnsional linear 
space F^ +1 over the p-element field ¥ p . Denote by n the natural projection 

7T : S/R- F™ +1 

Let Q E Lat„ satisfy R C Q C S. 

The function eQ is zero outside S n ; if £ — 77 E i?", then cq(£) = eg (77). This 
allows to consider the functions eg as functions on the quotient group 

S m /R m ~ F™ +1 © • • • © F™ +1 ~ F(, m+1)m . 



More precisely, for each linear subspace L C F™ +1 we define the function 

iy° dim ( L ) m / 2 , if Wi E L for all j; 
e L {wi®---®w m ) ■= < n , . 

0, otherwise. 
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If Q lies between R and S, then L := Q/R is a linear subspace in S/R = 
F™ +1 . Obviously, we have 

e Q (0i ffi •• • ffi 6 m ) = e L {-K{0i) © • ■ • © tt(0 to )) 

Thus, it is sufficient to investigate the linear dependencies of the functions e^. 
5.3. Proof of Theorem 2.8. For k = 0, . . . , m + 1 consider the function 
fe on ffp ' given by 

G fe (wi © •• • ®w m ) = p - km / 2 e L (wi ©•••ffiw m ). 

fc:codim L—k 

We intend to find numbers uq, . . . , u m such that 

5>*G fc = 0. 

Lemma 6.1 u k = (-i) k p k( - k - 1 )/ 2 . 

Proof. Obviously, Gk(wi(&- ■ -®w m ) coincides with the number of subspaces 
L of codimension fc containing all the vectors wi,. . . ,w m . Denote by W the linear 
span of Wj. We must count subspaces in F™ +1 containing W, or equivalently, 
linear subspaces in ¥™ +1 /W. 

The number Af of j-dimensional subspaces in F^ is 

■_ (p'-l)^'- 1 -l)... (p'-^-l) 
1 (p*-l)(p*-i-l)...(p-l) 



Hence, our Lemma is equivalent to the family of the identities 

(p s -i)(y- 1 )...(y ; - i+1 -i 
(pi_i)(pi-i_i)...(p-i) 



i=0 



For this identity, we can refer to [7], Ex.I.2.3, or to the q-binomial theorem 
(see, for instance £Q, §1.3) 



E 



(1 - aq){\ - aq 2 ) . . . (1 - aq 1 - 1 ) . _ (1 - az){\ - azq)(\ - azq 2 ) . . 



(l-g)(l -«»)... (l-z)(l- V)(l-^ 3 ).-- ' 

we substitute q = l/p, a = p s , z = q. 
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